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Abstract — Constructing and studying distributed control systems requires the analysis of the 
Laplacian spectra and the forest structure of directed graphs. In this paper, we present some 
basic results of this analysis partially obtained by the present authors. We also discuss the 
application of these results published earlier to decentralized control and touch upon some 
problems of spectral graph theory. 

PACS numbers: 87.19.lr, 02.10.Yn 

1. INTRODUCTION 

In the cooperative control of distributed multiagent systems, the generation of control actions 
is decentralized. The actions result from negotiations between agents. As a metaphor, we can 
remember [1] that the musicians of "Persimfans'il], which existed in Moscow between 1922 and 
1932, performed extremely complex musical compositions without a conductor. The string section 
formed a full circle (partly with their backs to the audience), while the wind section was situated 
inside of that circle. Every musician not only heard, but was also able to see the others. This 
way the magic chemistry among the performers, harmony and dynamic coordination between all 
the participants brought such a synchronization, that it became the substitute of the role of the 
conductor. Amazingly, one of the Persimfans' distinguishing features was their ability, according 
to the testimony of the extremely demanding and tough critics, to maintain a particularly subtle 
and profoundly individual approach to the interpretation of musical pieces, normally unthinkable 
without the help of the conductor. 

The theory of decentralized control has a long history. In addition to the works discussed 
in [1], one can remember the theory of statistical consensus by DeGroot [2], methods of step- 
by-step coordination of expert judgements, such as Delphi methodology developed at the RAND 
Corporation in the 1950s [3] , works on distributed networked computations and distributed decision- 
making [4, 5] and, of course, modeling the collective behavior of animals (see, e.g., [6]). Starting 
from 2003 (approximately) we can observe an avalanche of publications on decentralized control 
connected with the application of spectral graph theory in this field. 

In this paper, we discuss continuous and discrete models of distributed coordination which can 
be considered as basic models of decentralized control. It is shown how the recent advantages in the 
algebraic graph theory (including some results published by the present authors before the "boom" 
imploded in 2003) can be applied in this area. 



Abbreviation for Perviy Simfonicheskiy Ansambl' (First Symphony Ensemble). 
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2. A CONTINUOUS MODEL OF DISTRIBUTED CONSENSUS 
Consider the basic continuous distributed consensus algorithm: 

n 

Xi{t) = -^aij{t) {xi{t) - Xj{t)) , i = l,...,n. (1) 

Here, n is the number of agents, Xi{t) is an information state (characteristic, parameter, etc.) 
of the ith agent, aij{t) > is the weight with which agent i takes into account the discrepancy in 
the information state with agent j. The information states can be, among others, positions (if the 
agents need to rendezvous in space), velocities (if they execute decentralized formation maneuvers), 
arrival times (if these must be synchronized), and so on. 

Decentralized control usually requires solving more complex problems than simply reaching a 
consensus. For example, if moving in formation is considered, then a typical task is moving along 
a prescribed course and in a prescribed and fixed configuration. During a violent maneuver the 
configuration can be altered, but after the maneuver it must be restored. 

Alteration and restoration of a prescribed geometric shape are also typical when a "fiock" of 
moving physical objects encounters an obstacle or a hazard. It should be noted that reaching 
consensus is an important element of control strategy in all such cases. Actually, it is a key 
element, because it usually determines the stability of the system, its controllability, etc. That is 
why the analysis and synthesis of consensus algorithms, such as (1), is a necessary component of 
solving various problems of decentralized control. In this paper we focus on graph theoretic results 
underlying the analysis of distributed consensus algorithms. 

Let r(t) be the communication digraph associated with the consensus model (1). The vertices of 
T(t) are identified with the agents, and T{t) has an arc from vertex j to vertex i (denoted by (j, i) 
or j i) if and only if aij{t) ^ 0. The presence of this arc in T{t) means that agent i coordinates 
its information state with that of j. The weight of the (j, i) arc is aij{t). 

In matrix form, model (1) can be written as 

x{t) = -L{t)x{t), (2) 
where x{t) = {xi{t), . . . ,x„,(t))^ and the matrix L{t) = [iij{t)]nxn is defined as follows: 

{-aij{t), j^i, 

L{t) is the Kirchhoff matrix of the communication digraph T(t). Sometimes, instead of T{t), the 
digraph T'{t) is considered such that j ^ i and aij{t) ^ result in the presence of the i ^ j arc 
(instead of j — > i in r(t)). With respect to T'(t), the matrix L{t) defined above is the Laplacian 
matrix. The classes of Kirchhoff matrices and Laplacian matrices coincide; they only differ in the 
way they are assigned to digraphs. We will call L{t) the Laplacian matrix of the algorithm (1). 

The process (1) is said to be convergent if for any initial conditions ^^(0), i = 1, . . . ,n, and every 
i, J = 1, . . . , n, it holds that \xi{t) — Xj{t)\ — > as i — > oo. 

The convergence properties of the algorithm (1) are determined by the spectral properties of 
the matrix L{t). 

3. SIMPLE PROPERTIES OF THE LAPLACIAN MATRICES 

By definition, L{t) has zero row sums, consequently, it is singular and the vector 1 = [1, . . . , 1]''' 
belongs to its kernel. Since the off-diagonal entries of L(t) are nonpositive, the diagonal entries 
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being nonnegative, and L{t) has a weakly dominant diagonal, by Gersgorin's, theorem the real 
parts of all nonzero eigenvalues of L{t) are strictly positive. That is why all nonzero eigenvalues of 
the matrix (— l)-L(t) in (2) have strictly negative real parts. 

The Laplacian matrix of an undirected graph is symmetric, positive semidefinite, and its spec- 
trum is real and nonnegative. Moreover, is a simple eigenvalue of this matrix if and only if the 
corresponding graph is connected (see, e.g., [7]). If = Ai < A2 < • • • < A„ are the Laplacian 
eigenvalues of an undirected graph, then A2 is referred to as the algebraic connectivity of the graph. 
This concept was introduced by M. Fiedler, and it is widely used in both theoretical studies and 
applications. 

The Laplacian matrices of undirected graphs have been much studied. They date back to the 
famous matrix tree theorem by Kirchhoff; A.K. Kelmans pioneered their systematic investigation 
in the 1960s and 1970s; in the 1990s, the results of their study were presented in a series of reviews 
by R. Merris ([7] is one of them) and B. Mohar; then the monographs [8, 9] were published. 

The Laplacian matrices of directed graphs and relationships between their properties and the 
properties of the corresponding digraphs are still very poorly studied. To some extent, this is due to 
the fact that the mathematical problems which involve the complex spectra of digraph Laplacians 
are much more difficult than the corresponding problems regarding the real spectra of ordinary 
graphs. At the same time, the need for such studies is well recognized. Distributed control is one 
of the applications where this need is particularly urgent. 

4. THE CONVERGENCE OF CONSENSUS ALGORITHMS 

Assume that the Laplacian matrix L(i) is kept constant: L(t) = L. It is not difficult to formulate 
a matrix-theoretic necessary and sufficient condition of convergence for the algorithm (2). As 
already mentioned, the vector 1 = [1, . . . , 1]'^ belongs to the kernel of L. If is a simple eigenvalue 
of L, then x{t) — > xl, where x is a scalar, consequently, \xi{t) — Xj{t)\ — s- as t ^ 00 for all 
i,j = 1, . . . ,n, and the coordination trajectories converge. As shown in [10, Theorem 4], the zero 
eigenvalue of L is always semisimple, i. e., its algebraic and geometric multiplicities coincide. Hence, 
if this eigenvalue is not simple, then the kernel of L is not one-dimensional, and the convergence is 
violated. 

Thus, the convergence analysis of algorithm (2) reduces to the determination of conditions under 
which is a simple eigenvalue of L. 

5. RANKS OF LAPLACIAN MATRICES AND A CONVERGENCE CRITERION FOR 
DISTRIBUTED CONSENSUS ALGORITHMS 

The rank of the digraph Laplacian was studied in [11]. 

Recall some graph theory notation. A digraph is called strongly connected (or strong) if it con- 
tains directed paths from every vertex into every other vertex. Every maximal (by inclusion) strong 
subgraph of a given digraph is called its strong component or bicomponent. A basis bicomponent 
of a digraph is a bicomponent such that the digraph does not have any arcs flowing into this bi- 
component from outside. It is easy to verify that every vertex of a digraph is reachable by a path 
from at least one basis bicomponent. If a basis bicomponent consists of a single vertex, we call it 
an undominated vertex of the digraph. A digraph is weakly connected if the graph obtained from 
it by replacing all arcs with undirected edges is connected. Weak components of a digraph are 
the maximal by inclusion weakly connected subgraphs of this digraph. A digraph is unilaterally 
connected if for any vertices i and j 7^ i, it contains either a directed path from i into j or a directed 
path from j into i (or both). Unilateral components of a digraph are its maximal by inclusion uni- 
laterally connected subgraphs. It should be noted that the relation of unilateral connectivity need 
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not be transitive, so it does not induce a decomposition of the vertex set into equivalence classes. 
Therefore, as distinct from the strong and weak components, unilateral components can overlap. 

A subgraph of a digraph is spanning if the vertex sets of the graph and subgraph coincide. 
A diverging tree is a rooted directed tree containing directed paths from the root into all other 
vertices. A diverging forest is a rooted directed forest all of whose weak components are diverging 
trees. 

For an arbitrary digraph T, consider its spanning diverging forests. Such forests are also called 
out-forests of T. A spanning diverging forest F of F is a maximum out-forest if T has no out-forest 
with the number of arcs greater than in F. It is easily seen that every maximum out-forest has 
the minimum possible number of weak components (diverging trees); this number will be called 
the out-forest dimension of T and denoted by d. The number of arcs in any maximum out-forest is 
obviously n — d, where n is the number of vertices in F. The following results were obtained in [11]. 

Proposition 1. Let L be the Kirchhoff matrix of a digraph F. Then rankL = n — d, where n is 
the number of vertices in F and d is the out- forest dimension of F. 

Proposition 2. The out-forest dimension of a digraph is equal to its number of basis bicompo- 
nents. 

Proposition 3. The out-forest dimension of a strong digraph is unity. 

Proposition 4. The out-forest dimension of a digraph is no less than its number of weak com- 
ponents and does not exceed the number of its strong components and the number of its unilateral 
components. 

Zero is a simple eigenvalue of L if and only if rankL = n — 1. That is why the above propositions 
imply Corollary 1. 

Corollary 1. Let L be the Kirchhoff matrix of a digraph F. Then is a simple eigenvalue of L 
if and only if F has a spanning diverging tree or, equivalently, F has only one basis bicomponent. 

By Propositions 1 and 3, the premise of Corollary 1 is satisfied, for instance, for any strong 
digraph. Later on, the first statement of Corollary 1 was obtained in [12-16]. 
Corollary 1 provides a convergence criterion for the consensus algorithm (2). 

Theorem 1. The consensus algorithm (2) with a stable Laplacian matrix L{t) = L converges 
to a vector with equal components for any vector of initial conditions a;(0) if and only if the cor- 
responding communication digraph F has a spanning diverging tree or, equivalently, has a unique 
basis bicomponent. 

A more general problem is describing the whole domain in the space of initial conditions be- 
longing to which guarantees the fulfillment of the \xi{t) — Xj{t)\ — > 0, i,j = l,...,n, condition, 
provided that convergence does not generally hold. This problem reduces to the analysis of the 
kernel of L. 



6. THE KERNEL AND EIGENPROJECTION OF THE DIGRAPH LAPLACIAN 

The eigenprojectioT^ corresponding to eigenvalue or, for short, simply eigenprojection of a 
square matrix A is a projection (i.e., an idempotent matrix) Z such that R{Z) = N^A"^) and 



It is also called principal idempotent. 
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N{Z) = R{A'^), where R{A) and N{A) are the range and the kernel (null space) of A, respectively, 
and u = ind^ is the index of ^, i. e., the minimum /c € {0, 1, . . . } such that raiakA^~^^ = rank A*^. In 
other words, the eigenprojection of A is the projection on N{A'^) along R(A'^). The eigenprojection 
is unique, as an idempotent matrix is uniquely determined by its range and kernel. A number of 
equivalent definitions of eigenprojection can be found in [17]. 

In [11] we considered the normalized matrix of maximum out-forests of a digraph denoted by J 
(the definition of this matrix is given below in Section 8) and proved the following properties of J. 

Proposition 5. Let L, d and J he the Kirchhoff matrix, the out-forest dimension and the nor- 
malized matrix of maximum out-forests of digraph F, respectively. Then rank J = d; = J; 
LJ = JL = 0. 

By the second statement of Proposition 5, J is a projection. By the third statement, R{J) ^ 
N(L) and R{L) C N{ J). Using the relationship between the ranks of J and L (rank J = d and 
rankL = n — d hj Proposition 1) and the semisimplicity of as the eigenvalue of L, we obtain 
that the above inclusions can be replaced with equalities. Finally, the semisimplicity of as the 
eigenvalue of L implies that indL = 1. Thus, the following two propositions hold true. 

Proposition 6. Let L and J be the Kirchhoff matrix and the normalized matrix of maximum 
out-forests ofT, respectively. Then J is the eigenprojection of L. 

Proposition 7. The linear spans of the columns and the rows of J coincide with the kernel and 
the left null space of L, respectively. 

By virtue of Propositions 6 and 7, matrix J is useful for the analysis of continuous distributed 
consensus algorithms. In Section 7, we will see that J is also applicable to the study of iterative 
consensus algorithms. 



7. ITERATIVE CONSENSUS ALGORITHMS 

Consider the finite-difference counterpart of the continuous consensus algorithm (1) with con- 
stant coefficients aij: 

n 

Xi{k + 1) = Xi{k) - e^Uij {xi{k) - Xj{k)), i = l,...,n, (4) 
i=i 

where k is the discrete time and e > is the step size. Rewrite algorithm (4) in matrix form: 

x{k + l) = Px{k), (5) 

where 



P = I-eL. (6) 

If the step size e is small enough, then P is a row stochastic matrix. This follows from the fact 
that L has nonpositive off-diagonal entries and zero row sums. The corresponding condition of the 
"smallness" of e is as follows [11]: 

< e < max . (7) 
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The matrix P = exp(— eL) corresponds to the continuous consensus algorithm (2), and (6) can 
be considered as the expansion of exp(— eL) to the linear term. Matrix (6) is sometimes called the 
Perron matrix with parameter e of digraph F. 

From (5), for any natural m one has 

x{m) = P'"x(0), (8) 

therefore, the properties of the process (5) are determined by the properties of the sequence 
{P, P^, . . . , P"*, . . . }. From the theory of Markov chains it is known that this sequence need not 
converge (the necessary and sufficient condition of its convergence is the aperiodicity of the chain), 
but the Cesaro limit (also called the time average limit) 

-. m 

P°°= lim —yP\ (9) 

i=l 

always exists and coincides with the limit of the sequence {P, P^, . . . , P™, . . . } in case the latter 
converges. Otherwise, if the chain is periodic with period s, then 

P°° = - I^P'^^) + . . . + P*^*)^ 

where p(^), . . . , p(^) are the limits of its converging subsequences: P^*-* = lim P-'^+*. 

It was shown in [18] that P°° is the eigenprojection of I — P. Hence, by (6), P°° is the eigenpro- 
jection of L as well. This fact along with the uniqueness of the eigenprojection and Proposition 6 
imply Proposition 8. 

Proposition 8. Let a row stochastic matrix P be connected with the Kirchhoff matrix L of a 
digraph F by equation (6) with e > 0. Then the matrix P°° defined by (9) coincides with the 
normalized matrix J of maximum out-forests of F. 

Thus, the matrix P°°, which determines the asymptotic behavior of the consensus algorithm 
(4), is equal to the normalized matrix of maximum out- forests of the communication digraph 
that corresponds to this algorithm. The matrix J is thereby important for the analysis of iterative 
consensus processes. Indeed, according to (8), to know the average asymptotic state of the algorithm 
(4), it suffices to consider the product P°°x(0) = Jx(0). To compute the matrix J, one can use the 
algorithm proposed in [19, 20], which reduces to min{n — d — 1, 0} multiplications of matrices of 
order n. 

It should be remarked that Proposition 8 coincides with the Markov chain tree theorem first 
obtained by Wentzell and Freidlin [21] and rediscovered by Leighton and Rivest [22]. 

Consider the convergence of the consensus algorithm (4). Since the spectral radius of P is 1, 
the convergence is violated only if P has an eigenvector not proportional to 1 = [1, . . . , 1]^ and 
corresponding to an eigenvalue of modulus 1. The subspace of invariant vectors of P coincides 
with the kernel of P, hence it is one-dimensional if and only if the premise of Theorem 1 holds. 
As for the complex eigenvalues of modulus 1, P can have them only if e coincides with the right 
endpoint of the interval (7). Indeed, in the opposite case, the increase of e up to the endpoint of the 
interval would have resulted in the appearance of an eigenvalue with the modulus greater than 1, 
in contradiction with the stochasticity of P (see also [23]). 

Consequently, the convergence of consensus algorithm (4) is guaranteed by the fulfillment of the 
premise of Theorem 1 together with the strict form of inequality (7). Otherwise, if e coincides with 
the right endpoint of the interval (7) and the Markov chain determined by the matrix P = I — eL 
is periodic, then the convergence is violated. 
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8. THE NORMALIZED MATRIX OF MAXIMUM OUT-FORESTS 

Can the entries of the matrix J, which proves to be useful for the analysis of consensus algorithms, 
be interpreted in terms of the communication digraph F ? Such a connection is specified by the 
very definition of J: every entry Jij of J is defined [11] as the ratio of the total weig hll of F's 
maximum out-forests that have vertex i belonging to a tree diverging from j to the total weight of 
all maximum out-forests in F. 

The following theorems [11] summarize the properties of J. 

Theorem 2. Suppose that V{T) = {1, . . . , n} and E{T) are the vertex set and arc set of a digraph 
F, K is the vertex set of some basis bicomponent of F, is the set of vertices reachable by paths 
from K and unreachable from the other basis bicomponents of F, K is the union of the vertex 
sets of all basis bicomponents, d is the out-forest dimension of F, J is the normalized matrix of 
maximum out-forests of F, T is the set of spanning diverging trees in the restriction Fx of F to 
K, is the subset of T consisting of the trees that diverge from j, T^k is the spanning subgraph 
of F with the edge set ^(F)\^(F/^), P^^* is the set of maximum out-forests of T-k in which i is 
reachable from some vertex that belongs to K, e{-) designates the weight of a set of subgraphs {equal 
to the sum of the weights of its elements), CTn-d the weight of the set of maximum out-forests 
of F. Then the following statements are true: 

_ - n- _ 

1. J is a row stochastic matrix: Jij > 0, and J2 Jik = ^ h 3 ^ ^(r); 

2. Jij ^ [j S K and i is reachable from j in F); 

3. Let j G K. For any i G V{T), Jij = e{V) e{P^^')/an-^d- Moreover, if i G Er+, then 
Jij = Jjj = e{J^)/e{J); 

4- J2 Jjj = ^- In particular, if j is an undominated vertex, then Jjj = 1; 

5. Ifji,j2 G K, then J.j^ = {e{T^'^)/e(T^'^)) J.j-^, where J.j^ and J.j^ are the ji and j2 columns 
ofJ. 

Corollary 2 (from the statement 3 of Theorem 2). 

1 . The normalized matrix Jk = Jfj of maximum out-forests of the digraph Tk coincides with 
the principal submatrix of J corresponding to the basis bicomponent K . 

2. If i (z and j G K^\K, then J is preserved under the variations of the weight of (i, j). 

The following Theorem 3 is concerned with the comparison of the entries of J. 

Theorem 3. In the notation of Theorem 2, let K{k) be a basis bicomponent of F that contains 
a vertex k K . For all i,j(z V{T) we have: 

1* Jii ^ 'Iji^ 

2. // Jii > Jji, then i & K , j ^ K~^{i), therefore, F contain no paths from j into i; 

3. If Jii > Jji > 0, then j ^ K, consequently, j is not the root in any maximum out-forest of F; 

4. // Jij > 0, then Ja = Jji. 

As mentioned above, these properties are useful for the analysis of the consensus algorithms (2) 
and (5) as well as generalizations of these algorithms, in particular, when the convergence is not 
guaranteed by the structure of the communication digraph. Some of the foregoing results regarding 
the kernel of the digraph Laplacian were also obtained in [24]. 



The weight of a digraph is the product of the weights of all its arcs. 
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9. OTHER PROBLEMS OF DECENTRALIZED CONTROL 



The distributed consensus algorithm (2) is the simplest algorithm of decentralized control. Yet 
this algorithm is a basic one, because the linear operator of agreement (— l)--L(t) it contains is an 
indispensable constituent of more complex algorithms as well. Therefore, the convergence properties 
of these more complex algorithms are in many respects determined by the spectral properties of 
the corresponding Laplacian matrices and by the forest structure of the related communication 
digraphs. 

In this section, we briefly survey some modifications of the consensus algorithm (2) and some 
other related problems of decentralized control. 

First of all, it should be noted that the model (2) does not generally imply that the commu- 
nication digraph T{t) is fixed. The rejection of this assumption makes the model more realistic. 
Indeed, in many applications the agents primarily communicate with the closest neighbors, but 
those can be acquired or lost during the motion. To preserve the relative simplicity of the model, 
some restrictions on the structure of the communication digraph are applied. Usually, either it is 
supposed to be piecewise constant and a set of possible switchings is specified or the weights aij{t) 
are defined with a permissible variation. Sometimes fiuctuation of the weights is described by a 
probabilistic model. As a result, the analysis, in most cases, reduces to solving a series of prob- 
lems with stable communication digraphs and combining the partial solutions. In some cases, the 
analysis involves the study of infinite products of stochastic matrices taken from a specific set [25]. 

Besides that, the model becomes more realistic if it allows communication delays. These delays 
can be associated with either information transmission or with processing messages after receipt. 
In this case, the model of the form (1) contains terms such as Xj(t — 5ij), where 5ij is a delay typical 
of the pair of agents {i, j)- If the delays are the same for all pairs of agents, then their presence 
does not essentially alter the properties of the coordination trajectories [26]. More general cases 
were considered in [27]. 

In many technical applications it is desirable to maximize the rate of convergence. An approach 
to solving such problems was developed in [28]. It is noteworthy that in case of undirected graphs, 
the problem of the best convergence is connected [29] with the maximization of the algebraic 
connectivity (the second smallest eigenvalue of the Laplacian matrix already mentioned in Section 3) 
of the communication graph. The algebraic connectivity itself can serve as a good measure of the 
convergence rate of the algorithm [30]. For the case of directed graphs, different generalizations of 
the algebraic connectivity were proposed, including the second smallest real part of the Laplacian 
eigenvalues [31], the second smallest modulus of the Laplacian eigenvalues, and the second smallest 
eigenvalue of the symmetric part {L+L'^) /2 of the Laplacian matrix [23, 32] . However, in the general 
case of digraphs, the problem of optimizing the convergence rate is still insufficiently studied. Not 
even the problem of localizing the spectra of nonsymmetric Laplacian matrices (see Section 10) has 
been completely investigated. 

Let us turn to some extensions of the model (2) that have a more complex structure. For the 
analysis of synchronization in systems of nonlinear oscillators and for solving some other problems, 
the following class of models was considered: 



It has been shown in [33] that in case of undirected communication graphs, the corresponding 
synchronization process is essentially determined by the algebraic connectivity of the graph. 



n 




7 > 0. 



(10) 
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The consensus algorithm for a double-integrator dynamics has the form: 

n 

Xi = -^aij{t){{xi- Xj) +'y{xi- Xj)) , i=l,...,n, (11) 
i=i 

where 7 > controls velocity matching. It was shown in [34] that T is of considerable importance 
here, however, for the algorithm to converge, as well as for the basic model (Theorem 1), the 
communication digraph must have a spanning diverging tree. 

More general differential models of the second order were used to describe the motion of the 
complexes (flocks, schools, troop, swarms, etc.) of physical objects. "Flocking" requires both 
maintaining the pattern formed by the objects' positions (up to translation and/or rotation) and 
formation maneuvering [31, 35]. In this case, the existence of a spanning diverging tree in the com- 
munication digraph is also a necessary condition of the effective control for many typical problems. 

10. LOCALIZING THE SPECTRA OF NONSYMMETRIC LAPLACIAN MATRICES 

For the analysis of models generalizing simple consensus models (1) or (4) it is necessary to know 
the whole Laplacian spectrum of the communication digraph rather then the sole multiplicity of its 
zero eigenvalue. Another important but rather difficult problem is recovering connections between 
the Laplacian spectrum of a digraph and the topological properties of the same digraph, including 
the "degree of cyclicity" and many others. 

The problem of localizing the spectra of Laplacian matrices was partially solved in [10]. Let us 
consider some results of this paper. 

A real square matrix of order n will be called a standardized Laplacian matrix if (1) its row sums 
are equal to and (2) its off-diagonal elements are nonpositive and do not exceed 1/n in absolute 
value. This standardization enables one to consider results on the spectra of Laplacian matrices 
with various n in the same framework. Standardized Laplacian matrices will be denoted by L. If 
the class Gb of weighted digraphs with positive arc weights not exceeding 6 > is considered and 
L(r) is the Laplacian matrix of a weighted digraph F G G;, on n vertices, then the standardized 
Laplacian matrix associated with F in this class is, by definition, L{T) = {nb)~^ L{r). 

Let J G M"^" be the matrix with all entries 1/n; K = I — J. Then K is the standardized 
Laplacian matrix of the complete digraph with all arc weights b in the class Gj,- Define the matrices 

P = L + J (12) 

and 

Lc = K-L. (13) 

By (12) and (13), P is a stochastic matrix, Lc being the standardized Laplacian matrix of the 
complementary weighted digraph Fc in which (6 — Sij) is the weight of arc {i,j), j 7^ i, provided 
that Eij is the weight of this arc in F. If Eij = b, then Fc has no {i,j) arc and vice versa: if F has 
no (i,j) arc, then the weight of in Fc is b. It follows from (12), (13) and the definition of K 
that 

P = L-L,. (14) 
Consider the results [10] connecting the spectra of L, P and Lc- 
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Theorem 4. Let L be a standardized Laplacian matrix; let P and Lc he defined by (12) and (13), 
respectively. Then for A ^ {0, 1}, the following statements are equivalent^ 

(a) A € spL; (b) A € spP; (c) 1 — A S sp Lc, 

and these eigenvalues have the same geometric multiplicity. Furthermore, v is an eigenvector of L 
corresponding to A ^ {0, 1} if and only if the vectoi^ 

I - -L^] y (15) 



1 - A, 

is an eigenvector of P corresponding to A and an eigenvector of Lc corresponding to 1 — X. 

Theorem 5. Let /7(A), /p(A) and fj (A) he the characteristic polynomials of L, P and Lc, 
respectively. Then for all A {0, 1}, 

/p(A) = ^/z(A), (16) 



flW = (-l)"-^^/7(l-A). (17) 



Theorem 6. For any standardized Laplacian matrix L and the corresponding stochastic matrix P 
defined by (12), L and P are semiconvergent. 

For completeness, the following theorem contains some results mentioned above. 

Theorem 7. Suppose that d and dc are the in-forest dimensions of the digraph whose standard- 
ized Laplacian matrix is L and the complementary digraph, respectively; m/i(A) is the algebraic 
multiplicity of X spA; V^(A) is the eigenspace of A corresponding to X. Then 

(i) mj^^O) = d, ^-^(l) = dc-l; 

(ii) mp(0) = d-1, mp(l) = dc, 

(iii) rn-^i'i-) = d-1, m~{^) = dc, 

and these eigenvalues are semisimple; 

(iv) ifve Vi{Q) and Kv ^ 0, then Kv G 1/p(0) = Vi (1); 
i/x G yp(l) = V~ (0) and Kx / 0, then Kx G ^-(1). 

Let A„ be the class of standardized Laplacian matrices of order n. We now turn to the problem 
of localizing the spectra of the matrices L G A„. The following results were obtained in [10]. 

Theorem 8. All eigenvalues of standardized Laplacian matrices of order n belong to the meet of: 

• two closed disks, one centered atl/n, the other centered at 1 — 1/n, each having radius 1 — 1/n, 

• two closed smaller angles, one bounded with the two half-lines drawn from 1 through e"^'^'/"' 
and e^'^^/", the other hounded with the half-lines drawn from through e~('^2-7rn)i ^^^^ ^{w2~Trn)i^ 

• the hand 19(^)1 < 

Remark. Using the theorem by Dmitriev and Dynkin [36] on the spectra of stochastic matrices, it 
can be shown that sp L contains an eigenvalue with argument f — ^ if and only if T is a Hamiltonian 
cycle on n vertices. In this case, such an eigenvalue A is unique, |A| < ;| sin ^, and 9(A) < ^ sin 

^ spy4 is the spectrum of A. 

^ For simplicity, we sometimes write A/a instead of {l/a)A, where A is a matrix and a 7^ is a complex number. 
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Fig. 1. The domain which, according to Theorem 8, contains the spectrum of each standardized Laplacian 
matrix of order n (hatched); in this figure, n — 7. 



The components of any corresponding eigenvector are the vertices of a regular polygon. Similarly, 
spL contains an eigenvalue that belongs to the segment [1, e^'^^/"] if and only if the complementary 
digraph Tc is a Hamiltonian cycle on n vertices. As above, such an eigenvalue A' is unique and 
9(A') < isin^. 

This remark and Theorem 8 are illustrated by Fig. 1. 
Let 

Afc(n) = 7i-i (yfc - _ . . . _ e-2Wn) (18) 

= f A; - ^^e-C^+^W^V fc = l,...,n-l; 

V sin ^ ; 

by S{n) we denote the closed convex polygon with vertices 

Ao(ri) = 0, Ai(n),...,A„_2(n), \n-i{n) = I, A„_2(n), . . . , Ai(n). (19) 

Theorem 9. Every point of the polygon S{n) is an eigenvalue of some standardized Laplacian 
matrix L € A^. 

Let /i(n) = sup{$J(A) : A is an eigenvalue of some L € A„}. 

1 TT 

By Theorem 8, for all n = 2, 3, . . . it holds that h(n) < — cot — . 



Theorem 10. // n is odd, then 



1 vr 
h{n) = — cot — , 



moreover, h{n) = 9 (A(„_i)/2(^)) i where A(„_i)/2(^) ^•s defined by (18). 
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Proposition 9. If n > 2 is even, then 

max 9(Afc(n)) = 9(A„/2(n)) = 1 cot - < ^ cot ^. 

0<fc<2n-i ' n n In In 

Corollary (from Theorems 8 and 9 and Proposition 9). lim h{n) = l/vr. 
Tlie following conjecture is yet unproved. 

Conjecture. All eigenvalues of standardized Laplacian matrices of order n belong to the poly- 
gon S{n) whose vertices are defined by (19). 

Note that the vertices Afc(n) and Afc(n) of the polygon S{n) belong to the spectrum of the 

standardized Laplacian matrix Lk in) = — iki — C — — ... — C^), where C = [cuv] is the matrix of 

n 

a cyclic permutation of order n with entries Cuv ~ | q' ^ i\i ^ ^ The digraphs whose 

standardized Laplacian matrices are Lk{n) belong to the class of balances digraphs, which are 
relevant to the synthesis of multiagent control protocols (see, e. g., [23]). In balanced digraphs, the 
total weight of arcs converging to any vertex is equal to the total weight of arcs diverging from it. 
Besides that, for these digraphs, the total weight of converging arcs is the same for all vertices, i. e., 
they are regular. 

If n is even and k < n/2, then of special interest are the matrices of the form Lfc(n) + S, 
where S = [sij] is the standardized Laplacian matrix of a digraph obtained from the digraph with 

standardized Laplacian matrix — (/— C"/^) by decreasing the weights of some arcs. It turns out that 

n _ _ 

the maximum imaginary part of the eigenvalues of Lk{n) + S does not exceed such a part for Lk{n), 
and the spectrum of Lk{n) + S is invariant under any change of nonzero Sij and Sji that preserves 
Sij + Sji. In other words, the spectra of the standardized Laplacian matrices Lk{n) + S depend on 
the total weights of opposite "diagonal" arcs of the digraph rather than on their individual weights. 

Theorem 11. The boundary of the polygon S{n) with vertices (19) converges, as n ^ oo, to the 
curve made up by the parts of two cycloids whose parametric equations are: z{t) = x{t) + iy(r) 
and z{t) = x{t) — iy^r), where r G [0, 27r] and 

x{t) = {2tt)~^{t — sinr), 
y(r) = (27r)"^(l - cost). 

Fig. 2 shows the polygons S{n) at n = 4 and n = 5 as well as the limit curve whose equation is 
given by Theorem 11. 

As mentioned above, the results on localizing the spectra of Laplacian matrices given in this 
section are necessary for the analysis and synthesis of control algorithms that contain reaching 
consensus as one of their elements (see, e. g., [31]). 



11. CONCLUSION 

Recently, decentralized control of multiagent systems has become one of the most popular and 
rapidly evolving branches of control theory. Dozens of research groups have published many hun- 
dreds of papers and since these groups are working concurrently and are studying similar mod- 
els, their results substantially overlap. To get familiar with this trend, the recent surveys and 
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Fig. 2. The polygon of the spectra of standardized digraph Laplacians at n = 4 and n — 5 and the limit oval 
specified by Theorem 11. 



monographs [23, 32, 37, 38] can be recommended. The methods of algebraic graph theory play an 
increasingly important part in the studies of the last decade dealing with multiagent systems. More 
specifically, the subject of these investigations is the relationship between the topological properties 
of digraphs that represent information interchange among agents and the spectral properties of the 
corresponding Laplacian matrices. At the same time, the Laplacian theory of directed graph^ is 
still insufficiently developed; the need for new strong results in this field is very acute. One more 
thesis accepted by most researchers is that for a new stage of its development, this discipline re- 
quires more experimental studied and more practical applications of the theoretical results. These 
will reveal to what extent the proposed algorithms are robust to perturbations and discrepancies 
between theory and real behavior. 
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